Papers by André Mendes Marques de Carvalho
Leveraging LLMs to Streamline the Review of Public Funding Applications (2025.emnlp-industry)
Copied to clipboard
João DS Marques, Andre Vicente Duarte, André Mendes Marques de Carvalho, Gil Rocha, Bruno Martins, Arlindo L. Oliveira
| Challenge: | Large Language Models (LLMs) have been used to improve evaluation processes, but there are concerns over reliability and potential misapplications. |
| Approach: | They propose to deploy AI-assisted evaluation in two government initiatives . they found that the solution increased reviewer productivity by 20.1% . |
| Outcome: | The proposed solution reduced reviewer productivity by 20.1% while keeping a negligible false-positive rate . the proposed solution reduces evaluation time by more than 2 months . |